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1. INTRODUCTION 

A teleoperation system is referred to a plant that is controlled remotely. Many teleoperation systems 
have been designed and used in the recent decades to help people in performing tasks remotely especially in 
hazardous environments. These tasks include working in a toxic or harmful environment, working remotely like 
telesurgery and explorations of space, and carrying out high precision tasks such as chemical and nuclear reac- 
tors. In general, teleoperation systems consist of a human operator, a master and slave manipulators connected 
through a communication network and the environment. The schematic diagram of a typical teleoperation 
system is shown in Figure 1. 

Teleoperation systems allow operator to exchange information of position, velocity, and/or force re- 
motely to perform the desired motion, sensing, and physical manipulation. The importance and wide applica- 
tions of teleoperation systems attract researchers in both control systems and robotics mainly focusing on the 
stability and the telepresence [1]-[3]. A lot of result are presented to handle practical control problems using 
several approaches such as anti-wind control [4], [5], fuzzy control [6], [7], adaptive control [8]-[13], passivity- 
based control [2], [14], [15], and slide-mode control [16], [17]. We will discuss these and other approaches in 
details in section 3. 

There are two main types of teleoperation systems: unilateral and bilateral teleoperation systems. 
When the transmission of motion goes from master to slave it is called a unilateral teleoperation system (UTS). 
On the other hand, a bilateral teleoperation system (BTS) includes transmissions in both the forward and 
backward directions between the master and slave [18]. Generally speaking, BTSs have more interest among 
researchers since they are more used in places that are difficult for humans such as underwater vehicles, airspace 
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applications, mining, and remote medical surgeries. Comprehensive historical surveys on BTSs are presented 
in [1], [19]. In 2011, Nuño, Basañez and Ortega [2], a tutorial on passivity based control on BTSs is provided. 
A survey on the environment and task-based controller system is shown in [20]. Also, a review on bilateral 
teleoperation with force, position, power, and impedance scaling is detailed in [21]. 

In addition to the basic requirements of stability, a major aspect to consider in BTSs is the trans- 
parency. Actually, there is a tradeoff between these two concerns mainly as a result of the time delays caused 
by the communication channel [22]. The delay-induced instability of BTSs is one of the main challenges 
for researchers since time delays exist in most communication channels. Some major studies based on time- 
delayed bilateral teleoperation have been done in [12], [23]-[25]. The time delays could be symmetric [26] 
as well as asymmetric [27]. Some recent studies on the stability analysis of asymmetric time-varying delay 
can be found in [28]-[30]. Most of the recent work on stability analysis with asymmetric time-varying delays 
employed Lyapunov—Krasovskii functional to formulate the relations among the controller parameters, and the 
upper bound of time-varying delays [31], [32]. Linear matrix inequalities (LMIs) were applied to present the 
stability criteria. So, it can be solved to obtain the allowed maximum values of delays. 
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Figure 1. Block diagram of the typical teleoperation system 




















Recently, many reviews on the BTSs were published. In 2018, Ghavifekr, Ghiasi and Badamchizadeh 
[33], discrete-time control methods of BTSs were presented with concern on problems of passivity, stability, 
transparency, and time delays. The recent control approaches for teleoperation systems while considering 
internet-based communication, unknown time-varying delay, and model uncertainty were reviewed [34]. More 
concern was given to control algorithms that were applied to nonlinear uncertain systems. The application of 
predictive control schemes in BTSs are discussed including qualitative and quantitative comparisons among 
these methods regarding robustness, transparency, and stability [35]. 

In this paper we address the control problem of bilateral teleoperation systems (BTSs) in nominal 
situations and in the presence of cyber-attacks. The main contributions of this paper are summarized as follows: 
— A discussion on the methods of modeling BTSs will be presented. 

— A comprehensive survey on control schemes for BTSs under cyber-attacks is discussed. 
— The literature that considers cyber-attacks in the design of the controller for BTSs is reviewed. 
— The current and future problems in this field are discussed. 

The remaining of this paper is organized as follows: Modeling of BTSs are discussed in section 2. In 
section 3, control approaches are presented. Then, the cyber-attacks in BTSs are described in section 4. Finally, 
Current and future research are listed in section 5. 


2. MODELING OF BTSS 
In section 2, we will discuss the modeling of BTSs. The dynamics of both the master and slave robots 
are derived by applying the Lagrangian systems with the actuated revolute joints such that shown in (1): 


Ms (qs)4s + Cs (qs, 4s) 4s + gs(qs) = -JE (qs)Fs + Ts (1) 
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with the subscripts {m} and {s} denote the master robot and the slave robot, respectively. qm(t) €” and 
qs(t) €™ are the generalized coordinates, Mm (qm) €"*” and Ms(qs) €™*™ are the inertia matrices. 
Cm(Qm; 4m) €"*" and Cs(qs, ds) €'*™ are damping matrices. gm(dm) €” and gs(qs) €™ are the gravity 
forces. T(t) €” and 7,(t) €’ are the applied torques which is deifned sometimes as the control signals. 
Im(dm) €"*" and Js(qs) €"*™ are the Jacobian matrices, and Fm (t), F',(t) €"*+ are the forces exerted by 
the human operator and the environment. See for example [10], [36], [37]. Let us assume that the slave robot 
is a redundant manipulator to obtain semi-autonomous teleoperation and the master robot is non-redundant 
manipulator for simplicity. 

Let x(t) defined as the state vector and equal to [2 (t) @m(t) x(t) ts(t)]T with x(t) and & are 
denoting the position and speed of the end effector, respectively. And by considering the external forces as 
disturbances, the general state-space model for system (1) is represented by (2): 














z(t) = Ax(t) + Bu(t) + Byw(t) (2) 
with 
0 1 0 0 
0-2 0 0 
aS 0 0 0 die 
0 0 0 -# 
0 0 
wz 0 
B = 0 0 = [Bi Bə] 
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0 0 0 0 
1. 0 a 0 
= Mm = — | Mm 
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0 M; 0 =y; 
T T 
u(t) = [Fre Fs], wE = [me FO] (3) 


In equation (2), the state variables are £m (t), &m (t), s(t), and s(t). For simplicity, the states £m (t) 
and m(t) are called local state variables and x,(t) and #,(t) are called remote state variables to the master, 
and conversely with respect to the slave. 

The following state-feedback controllers are designed to obtain the stability for the master and slave 
manipulators as (4): 
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where dı (t) and d2(t) are the forward time delay (the communication path from the master to the 
slave) and the backward time delay (the communication path from the slave to the master), respectively. 


Remark 1. It is more practical to have upper limit on the time delays such as positive scalars dı and dz. So, 
dı (t) and dg(t) are bounded as, 0 < dı (t) < d1,0 < d2(t) < d2 [38]. 





The controllers Fm (t) and F; (t) is formulated in the following compact system: 


Falt) = Kma(t—da(t)) 
K,x(t — dı(t)) (5) 


ot 
I 


By substituting the controllers (5) in the BTS (3), one will obtain the following overall closed-loop 
system shown in (6): 
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3. CONTROL METHODS FOR BTSS 

Many literature discuss the challenges of controlling teleoperation systems [39]. The focus of these 
surveys directed to adaptive control, wave variable, and predictive control approaches [35], [40], [41]. Various 
methodologies were proposed to handle control issues in several applications of teleoperation systems. Some 
examples are: nonlinear trilateral teleoperation systems [42], PD-like controller [43], four-channel structure 
[44], operator dynamics considerations [45], output feedback with force estimation [46], a stable and trans- 
parent microscale teleoperation [47], external force estimation [48], position synchronization [49], and new 
stability criteria using hybrid strategies of position and impedance reflection [50]. 

As mentioned in the Introduction, some recent literature discusses the control of BTSs. In 2018, 
Ghavifekr et al. [33], discrete-time control methods of BTSs were presented with concern on problems 
of passivity, stability, transparency, and time delays. The recent control approaches for teleoperation 
systems while considering internet-based communication, unknown time-varying delay, and model 
uncertainty were reviewed [34]. More concern was given to control algorithms that are applicable to nonlinear 
uncertain systems. The application of predictive control schemes in BTSs are discussed including 
qualitative and quantitative comparisons among these methods regarding robustness, transparency, and 
stability [35]. In section 3, we will discuss several kinds of control approaches applied to BTSs and the 
feature of each method will be explained. These approaches are summarized in Figure 2. 


Figure 2. Control approaches applied to BTSs 


wn 
Nn 
F 
[aa] 
= 
2 
n 
me) 
oO 
Js 
p=] 
(3) 
2 
© 
= 
= 
= 
fo} 
1S) 





3.1. Passivity based control approach 

Passive systems are referred to dynamical systems that have positive consumption of total energy. 
Passivity based control is a control approach that aims to maintain the passivity behavior of the closed-loop 
system. So, in this approach, the controller is designed and formulated to keep the balance of the power flow 
and energy consumption of the BTS [51]. One of the challenges in BTSs is the occurrence of time delays in 
the communication channel. In addition to its effect on the signal, the time delay could also increase the energy 
in the communication channel [52]. This could affect the passivity of the BTS and may lead to instability. To 
handle this issue, several control approaches based on passivity have been proposed. The passivity-based con- 
trol approach is suitable and applicable to nonlinear systems, distinctly to mechanical/Euler-Lagrange systems 
[53]. 

Let us consider the BTS (1), the input power of this BTS in terms of the passivity is given by [54]: 


Palt) = 2y (7) 


where z is the input and y is the output of the system. 
The input power flow in the BTS (1) is formulated as (8): 


Bata 1] * |. 8 
The passivity of system (1) is assured if and only if a state function E (qi, i) > 0,V(q:, qi) exists and 
satisfies the following inequality [54] as (9): 


d 
Elg) < Pa 
di (di, di) (9) 
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Many literature refers to the energy storage function by E (q;, ġi) and the dissipative rate by 4 E (qi, di) 
[51], [53]. 
The previous inequality (9) is represented by the following (10): 





OE (Gi, %) : OE (a, qi) m : 
Od a Odi 4i S | dm fe ] | n (10) 


Now, consider system (1) and several manipulations to describe the torque control signals 7; as (11): 


OE 
ôdi 





Mn <[ 4 EA a see 


jol T gg M (Cine + 9 — fi) (11) 
where i € {m,s}andj € {h,e}. Finally, the passivity-based control approach is summarized as follows: 
Design a suitable 7; such that (11) holds for all q; and q;. 

Many works of literature investigate this control approach. In E. Kamrani [55], a multivariable control 
method with wave-prediction and passivity technique is proposed for real-time systems in the presence of 
internet delay dynamics. A synchronization scheme for nonlinear dynamical networked systems including 
delays and uncertainty is designed using passivity analysis [13]. A two-layer control scheme has been discussed 
for maintaining the stability of BTSs [56]. This scheme consists of one layer to assure the transparency and a 
second one for handling the passivity of the system. In 2010, K. Hertkorn et al. [57], a general time-domain 
passivity control approach is applied for a haptic system with multi-degree of freedom. Other examples on this 
approach including stabilizing the energy or position drift compensation can be found in [58]-[63]. 

Some advantages of this approach in the literature include: applying switching method for energy 
dissipation [64] or independent of time-varying delay [65], the combination of passivity and transparency [56], 
applying it to non-ideal system [61], applying both power-based and energy-based approaches [60], and the 
elimination of system uncertainties [66]. 

On the other hand, some drawbacks of this approach include: weak transparency [64], the transparency 
is not guaranteed in the passivity layer [56], limited application and no consideration of delay [61], applied to 
a system with constant delay [58], and limited random delays [60]. More examples on the passivity-based 
control approach are [2], [14], [15], [67]-[71]. 


3.2. Wave variable-based control 

The first introduction of the wave variable-based control approach was in 1991 by Niemeyer and 
Slotine [72]. 

The following transformation is applied to the reference signals in the BTS, i.e. joints velocity and 
external forces ġ; and f;,i € {m,s} and j € {e, h} to obtain a wave formulation shown in (12) and (13). 


tn =e (FEO + bl) (12) 
us = (Felt) -W 0) (13) 


Now, the new signals um and us are sent by the communication channel. Additionally, the desired 
signals for tracking will be fý and q3, and the communication channel has a characteristic impedance b. So, 
the flow of power in the communication channel between the master and slave robots are given by (14): 


Palt) =F Om lt) — FP OEO (14) 
=5 (uF (tem (t) — Bm) + 5 (uF Eust) — oF (toH) 


where Vm (t), vs(t) are the received signals and um (t), us(t) are the reference signals on the master and slave 
sides of a BTS satisfying by (15) and (16): 


fh (t) = bm (t) + V2bum (t) (15) 
EO = 5 (W2bo5(t) — felt). (16) 
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The researchers have developed and designed controllers for BTSs in the wave domain due to the fact 
that intrinsic passivity is preserved in the wave formulation [73]-[79]. However, the passivity could be unsaved 
in the power signals. According to this feature, it is important to build and place a passive filter at the master 
robot for estimating the model of the slave robot and enhance the force reflection in haptic applications. A 
similar proposal was provided for constant known delays [78], [79]. 

An incident named wave reflection occurs when the characteristic impedance of the network channel 
is not similar to that of the ports of the master and slave. Since it has a high impact on the BTS performance, 
wave reflection must be handled cautiously in the system design. Normally, the impedance matching element 
b is used for tuning this feature at both sides of the communication channel. But, the performance of the 
BTS, mainly the position tracking could be affected by this parameter. To overcome this scenario and decrease 
position drift, parameter b is not considered on the master side [79]. To notice the difference between these two 
ways, the position tracking drifts for the master side when b is removed is given by (17) and (18): 


1 $ 
e-a- j E a7 
and when t is not removed 
1 f 
ialt- a) -0O = 5 f dnt al) (18) 


It is noted here that as b increases, the position drift decreases. Nevertheless, since more damping is 
introduced, the BTS will have a poor performance. 

Some advantages of this approach in the literature include: the improvement of position tracking 
[73], optimization of wave transformation [77], the improvement of tracking and power optimization [80], 
dealing with passive and non passive human model [76], and guaranteed passivity [75]. The drawbacks of this 
approach include: the existence of estimation error [73], no consideration of time delay [77], [80], reducing the 
transparency [76], and considering constant time delay only [75]. 


3.3. Adaptive control approach 

The structure of BTSs includes several important parameters and model uncertainties to be concerned 
by designers. These parameters are revealed in all of the elements of the BTS shown in Figure 1, i.e. the master 
and slave robots, the communication network, the human operator, and the environment. 

The adaptive control approach is widely applied by researchers to solve the problem of the existence 
of the uncertainties in BTSs. Moreover, a lot of works and efforts were invested in this approach due to the 
linearity of parameters of BTSs as noted in (1). 

To understand this method, the general design of the adaptive controllers for the BTSs is given by (19) 
and (21). The human operator and the environment are presented as a general nonpassive nonhomogeneous 
force as follows (19): 


AO MOEA +D) + Ky Ha, () + Folt) 
Mi(qi)ği + Cilqi, di + ĝilqi) + O) = Ti + fj (19) 
where M. z D;, K j, and fio are the estimation parameters of the mass, damping, stiffness, and nonhomogeneous 


parameters of the human operator, i € {m, s} represents master and slave systems, and 7 € {h, e} represents 
the human and environment, respectively. 


Remark 2. The same philosophy could be applied for external disturbance rejection inserting a bounded term 
representing the external disturbance 6(t), as (20): 


|5(t)|| < A < œ (20) 


In this scenario, an adaptive parameter ôt) is needed to be added to the control signal in the BTS (1) 
such that (21) and (22): 


r= fi(t) + M(t)a + C(a,4)4 + òla) +ê) (21) 
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in addition to the term of the PD controller 
a= des i Kae = Kye (22) 
where Ka, Kp > 0 are symmetric matrices. 


Then, after some manipulation and linear parameterizing, the dynamics of the BTS are formulated as 
(23): 

M(ë + Kaé + Kye) = Y (q, å, (Et) + 5(t) + FE (23) 
with the estimation error of the corresponding parameter is indicated by the sign ~. So, these estimated 
parameters have to be handled in the design of the controller to achieve or maintain the stability and the task 
performance of the BTS in the presence of uncertainties. The adaptive law for (t) and 6(t) is obtained by 
applying the stability analysis such as the Lyapunov theorem such that the convergence of the error signals to 
zero is achieved and the estimation errors are bounded [34]. 

Additionally, one of the general methods in adaptive control design is to utilize the linearity in the 
parameters of the BTS (1). Let the combined error signals of both position and velocity of the master and slave 
be defined as (24) and (25): 


Em = Em T Limem (24) 


and 





€s = Ès + Pres (25) 


where Pm, P; > 0, so, the control signals are (26): 


ui = —Uia — Mi(qi) Pid — Ci(Q, ġdi) Pigi 
= —Uig— U;6;, LE {m, s} 
and the closed loop BTS will be (27): 


(26) 


Mièi + Ciei = Vili + uia — fi 2 {m5} j € {h,e} (27) 


will guarantee both of the errors’ asymptotic convergence and the parameter estimation errors ĝ; to be bounded. 


Also, the Lyapunov analysis or any other stability analysis could be used to derive the adaptation laws ĝ;. 


Remark 3. The adaptive control approach could be combined with intelligent and some nonlinear algorithms 
like fuzzy control and neural network (NN). This feature allows researchers to design new algorithms to enhance 
and improve the performance of the BTSs which makes it one of the most powerful control approaches. 


The designed control system using the combination of algorithms leads to a more robust and efficient 
BTS. Moreover, it is not necessary to have the exact model and precise information about the BTS. Also, 
these algorithms allow overcoming other restrictions in the BTSs, for example, long time-varying delays, input 
saturation, packet loss, force reflection error, and position drift. 

An adaptive switched control considering passive and non-passive external forces, actuator saturation, 
and unknown dynamics is designed for BTSs including asymmetric time-varying delay [81]. The obtained 
scheme has the capability of adaptive systems which is indicated by the achieved bounded position tracking 
error of the BTS. An adaptive fuzzy control system was developed to attain the state-independent input-to- 
output stability for a multilateral asymmetric teleoperation system [82]. Also, similar works are found such as 
[83]-[85]. 

Chen et al. [86], an adaptive finite-time control method is presented using subsystem decomposition. 
The stability is guaranteed by applying the Lyapunov-Krasovskii analysis and bounded tracking error is ob- 
tained. Robust adaptive techniques were proposed for considering unknown parameters the uncertainties of the 
BTS [87]. More examples on this approach are [8]-[13], [41]. 

Some advantages of the adaptive control approach in the literature include: considering non-homogenous 
and state independent input/output stability [81], [82] non-passive input forces [24], considering drift diffusion 
improved haptic [88], and multi robot slave and input saturation [89]. The drawbacks of this approach include: 
chattering of torque [81], [82], [89], does not consider time delay [88], constant time delay [90], and non 
assymptotic stability [24], [87]. 
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3.4. Robust control approach 

The main objective when applying the robust control approach is to consider the worst conditions 
which have negative effects on the stability and the performance of the BTSs. So, the control scheme is called 
robust when it maintains the stability and the performance of the BTSs affected by disturbing factors. In 
addition to the elements affecting normal systems such as the uncertainties in the model, neglected dynamics, 
and external disturbances, the network-induced uncertainty is the most tragic element that affects the stability 
and performance in BTSs. 

In mathmatic words, the robust control problem is minmax problem such that it is a minimization of 
the fraction y, = ||y||/||6|| while the term y, = ||y||/||a|| is maximized, with y, refers to the disturbances’ 
contribution 6 in the output of the system y, with the desired input z. ||.|| is any Euclidean norm function. Ideal 
value for y, is 0 and for y, is 1. 

The sliding mode control (SMC) is the most familiar robust control approach. In this technique, the 
controller is designed to achieve the convergence of the error signal to a predetermined sliding surface. This 
surface is a differential equation for the error which has a solution lying on a convergent set or point. One way 
for SMC is to define the error between the motion of the master and slave robots as e = £s — KZ. So, the 
sliding surface is given by (28): 


s=é€+€ (28) 


in which À > 0 is a constant used for determining the features of the surface and the error’s rate of convergence, 
and K > 0 is a coefficient matrix for scaling. 


Remark 4. A dissipation condition must be met to guarantee the robust stability as the following foe example: 
så < —9||s|| < 0 


where y > 0 is a constant. Either large gain or chattering control signals will be generated to obtain this 
feature. 


A chattering-free SMC approach is presented to achieve a robust performance of a BTS in uncertain 
conditions [91]. The number of the needed sensors is reduced by applying a pseudo-sensorless approach which 
also decreased the uncertainties affecting the BTS. A PD controller is proposed for specific delayed BTSs using 
the linear matrix inequalities (LMI) technique [92]. The BTS has been stabilized regardless of the occurrences 
of delays in the communication channel. But, the presented PD controller was applied only on the slave robot 
and designed for the constant time delay. 

The robust control approach is more suitable for linear systems because of the norm-based analysis 
and calculations. So, Some techniques of the robust control like H2, Ha, and pu-synthesis are applied for 
linearized time delay BTSs. These techniques are normally used in the frequency domain to handle the worst 
case scenario, uncertainties, and the upper limit of the delay of the linearized BTSs. 

Some advantages of the adaptive control approach in the literature include: reducing time sensitivity 
and convex optimization using H approach [93], achieving optimal transparency using Hə — H approach 
[94], maintain passivity [86], considering time varying uncertainties [95], and simultaneous stability and trans- 
parency [96]. The drawbacks of this approach include: considering linear model with constant delay [93], [94], 
[97], linear model without time delay [95], occurrences of chattering torque [86], [96], constant time delay 
[98]-[100]. 


3.5. Neural network-based approach 

One of the worst features affecting the stability and the performance of BTSs is the existence of time- 
varying delays. Some literature considering this situation by considering the input saturation with time-varying 
delay using adaptive fuzzy control method [101] or applying two controllers, a PD-like and P-like controllers 
to handle constant delay and time-varying delay, respectively [102]. 

The neural network (NN) based approach for controlling BTSs has a great value due to its high poten- 
tial to learn and parallel adaptive processing. These features make the NN more practical for complex nonlinear 
BTSs and suitable to deal with the time delays and uncertainties existing in the BTSs. The basic idea of NNs 
comes from the neuron system in the human body. So, similar to the cell model, they have dendrite weights 
wj, a nonlinear function o(.) which is normally called the activation function of the cell as shown in (29), and 
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a firing threshold wo. Let the output signal of the n-dimensional input signal x(t) € R” to be y(t). So, the 
neuron is represented by the following (29): 


y(t) =o | X` wjx;(t) + wo]. (29) 
j=l 


The insight of the neuron is excitatory synapses when w; > 0 and it is inhibitory synapses when 
wj < 0 [103]. The activation function o(.) is introduced separately and related to the requirements of the 
current application. It also shows the behavior of the cell in the case that y(t) is in its range. Also, since the 
derivative is required in learning algorithms for many cases, ø (.) has to be differentiable. Both the input vector 
and weights vector are assigned to derive the output signal. So, we will get the following (30): 


y(t) = o [wo, W1,---, Wn] [1, £1, En] 


= o (W' X(t) + wo). (30) 


Remark 5. For the case of the multicell model of a neuron consists of r cells, with an input signal X(t) and an 
output Ym (t), the system is represented by the following (31): 


FE) = [vi Y2- Ym] = E (WRC) + Wo) G31) 
in which the weight matrix is given by (32): 
W = [wij], i =1...r,j=1...n. (32) 


The features of the NNs allow researchers to apply them in a wide range of applications to solve the 
nonlinear and uncertainty problem for both control and estimation problems especially in robotics and BTSs 
[66], [89], [104], [105]. A comprehensive discussion on the application of NNs for robotics control is presented 
in [103]. 

NNs were used in BTSs for approximating and dealing with delays and uncertainties of the com- 
munication channel. So, NNs are applied for modeling the delay in the system d;(t) and d,(t), or the total 
transmission between the master and the slave. Let us assume that the position signal of the master robot 
XLm(k) has to be transmitted to the slave side at the sampling time k. One can develop the NNs for modeling 
the network to estimate this process as follows (33): 


dm(k) = Tyn(@m(t)),¢ € [1,2,...,k — 1, k] (33) 
with Tyn(.) represents the NN model obtained by (34): 
Tyn(@m(é)) = E (WT am(i) + Wo) - (34) 


The local controllers on the master and slave sides are designed to provide a prediction on the trans- 
mitted signals using the estimator model of the communication channel. So, the control signal in this system 
will be more efficient in comparison to the normal case where the signals received by the controllers could be 
affecting by the delay or the distortion in the system [34]. 

A prediction algorithm using adaptive linear NN was developed for the application of an internet 
time delay system [106]. Auld et al. [107], a Bayesian NN was implemented for classifying the internet 
traffic without information about the IP. The proposed method provided 95% accuracy after testing it on a real 
training NN for 8 months. A recurrent NN was utilized for modeling and predicting the Internet end-to-end 
delay [108]. The recurrent NN was trained and validated using the discrete-time data obtained by measuring 
the delay between two different nodes. NN approach was also implemented for modeling traffic flow in self- 
similar computer networks which is statically do not depend on time [109]-[112]. Other examples including 
further details could be found in [113]-[115]. 

In addition to the aforementioned applications, NNs were implemented in the local controllers on 
both sides of the BTSs. A better performance was obtained by combining the NN approach with other control 
methods, mainly the adaptive control method [66], [89], [104]. Another application of the NN in the BTSs is to 
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utilize the NN in designing the control system for estimating the delayed or disturbed signals and for protecting 
the system simultaneously when it is subjected to uncertainties and latency [34]. However, it is worth knowing 
that the parameters of the NN structure such as the number of layers, the number of neurons, etc. affect the 
accuracy of the estimation process. So, the application of the NN control approach handle the uncertainties and 
delay indirectly by giving the best possible result within the unknown circumstances of the system. A radial 
basis function (RBF) NN-based procedure was proposed for handling variable delays in teleoperation system 
[36]. The model contains linear viscous and Coulomb velocity-dependent frictions. But, it is required to 
measure the acceleration or to estimate it, and this is not practical in many cases. The following RBF Gaussian 
functions were applied for approximating the dynamics of the BTS (1): 


Sn(2) = exp( - zzz lle — Cull?) (35) 


1 
2H? 
where Hp is the width and C'n is the center for the nth neuron. 


Dyn,(x;) = W,'®;(x:) + & (xi) (36) 


where x; = (az a i qZ, å ; HT, iT, gi |? . Therefore, the following approximated dynamic are implemented in 


the control system to overcome both of the unknown bounded terms and the inverse dynamics by (37): 
Dyn; (xi) = fbilqi, ds) + gi(qi) + Cilqi, Gi) + Mjëi + Bjti + Kjxi + Di(t). (37) 
Thus, the control signal 7; is calculated for the following system shown in (38): 


MiG) di + Cildi, didi + Gi(G) + fbilqi, di) + Di(t) 
= m; + Mji + Bjti + Kjzi + fjo + Dyn,(x:) 
= W(x; )0;. (38) 


The desired control signal for system (38) when the function Dyn, is ideally approximated, is obtained 
using (39): 
Ti = Miq) (Ë — Koi(Gi — &) — Krila: — 4) (39) 


with positive-definite gain matrices Kp; and Kp; that by substituting in (38) leads to a Hurwitz function show 
in (40): 


The NN-based approximations are inherently intelligent enough to use the previous experiences of the 
BTS for learning, although they have an error in real applications. The accuracy of the approximation could be 
increased by selecting large quantities for NN nodes n in (35) for function Dyn(x) over a compact set of the 
input x € Qy C Rz. Other methods of control were combined with NN to decrease the unavoidable estimation 
error. A neural adaptive control was proposed for a single-master multi-slave BTS [89]. The use of the NNvto 
model of the unknown nonlinear plants helped to handle the uncertainties in the dynamics of and the input of 
the BTS. But, several assumptions were applied in this scheme such as the singularity-free motion of the slave 
robot, the rigidity of the object, and rigid attachment between slaves’ end-effector and the object. 

Consider the signals of the combined error to be (41): 


Tm =Lm + DPmemw, mr = —DPmem 


Ts =f; F Ls; Lsr = =I sē; (41) 


with error definitions em(t) = £m(t) — zs(t — dy(t)) and es(t) = x(t) — £m(t — dy(t)), and matrices 
Im, T, > 0. Then, the adaptive control signal is selected as (42): 


Um = —BmOe Om (Zm)sgn(Tm) 
Us = —B,O2 ®.(Z,)sgn(rs) (42) 
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where Zm and Z, are the state-based vectors with elements, such that ||tm|| and ||ëmr||, and ||čs|| 
and ||ësr||, respectively. The parameter estimated vectors 07, and OT with the adaptation signal is represented 
as (43): 
O; = —a,90, +4, ||r5||V. 


where am, as, Wm, and ws are positive controller designed parameters. The adaptive system (43) is used to 
update the parameters of model (38), So the error in the system (41) will converge to zero by applying the 
NN-adaptive control structure (42). 

Another challenge in BTSs is the problem of inverse kinematics of serial robots’ manipulators. An 
NN-based control scheme designed while considering kinematic uncertainties for a multi-master single slave 
BTS [105]. The error was minimized by estimating the Jacobian matrix that relates the joints’ and Cartesian 
velocity of the slave robot by considering the constraints affecting the workspace. Some advantages of this 
approach in the literature include: applying NN for modeling backlash-like hysteresis and obtaining smooth 
torque [104], considering kinematic uncertainties with Markovian time delay [105], considering unknown vary- 
ing delay [66], and handling input saturation and achieving smooth estimation [89]. The drawbacks of this 
approach include: the obtained tracking error is non-asymptotic [104], the delay is state dependent [105], did 
not consider the existence of external disturbances [66], and exist of chattering in the obtained torque [89]. 


3.6. Fuzzy control approach 

The fuzzy control was proposed by Zadeh [116]. The idea of the fuzzy control approach is applying 
fuzzy sets for developing a decision algorithm. It mainly includes several fuzzy if-then rules which are applied 
to find the system’s output related to each set of input. There are four elements for each fuzzy system: inference 
rules, fuzzifier, defuzzifier, and membership functions. Let us consider the following example of a statement 
that describes the kth rule R) in which the membership function is Gaussian, the fuzzifier is a singleton, and 
the defuzzifier is center average 

RC) : IF 21 is AK and... and £n is Ak, then y is Br k =1,2,...,K with the linguistic variables 
associated with the system inputs defined by X = [11,22,...,2n]’ € U C R” and output of the fuzzy logic 
system y € R. Also, the inputs from the set A to the outputs in the set B is mapped by the fuzzy system using 
a nonlinear algorithm. 

The fuzzy control approach is an efficient method for the approximation and modeling of complex and 
non-linear BTSs. A two-layer fuzzy controller was designed to protect a remote mobile robot in the case of a 
failure in the communication [117]. A multilevel fuzzy approach is implemented to enhance the robustness of 
the fuzzy system bu using several hierarchical fuzzy rules [118]. In 2016, Zhai and Xia [83] an adaptive fuzzy 
control system using a switching strategy is presented for the application of multi-robot cooperation affected by 
time-varying delays. In the same direction, an adaptive fuzzy controller is proposed for synchronizing multi- 
robot BTSs including random delays and dynamic uncertainties [84]. The robustness and the stability of the 
BTS were achieved by applying the LMI-based Lyapunov-Krasovskii method under stochastic circumstances. 














The membership functions were selected to be Gaussian such that p+; = exp ( — Cuza), A fuzzy control 
ji 


system was designed for a BTS including friction forces [85]. The defuzzifier is chosen as center average and 
the fuzzy outputs are given by the following (44): 


D y'( Mi= Ho (x:(¢))) 
Da Mi= ut (æ:(t)) 





y(X) = (44) 


with linguistic variables «;(¢) and maximum value of yf for each ut., so, ył; (yÎ) = 1. 
Using the fuzzy basic functions 


y(&) = 6” (t)v(&) 


in which 
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and 
v;(X) = Mi Lp (ai(t)) 
J a l n j a 
2 j= Mi= Hr: (ai (4)) 
Knowing the universal approximation theorem, the estimation of the dynamic equation Dyn(x) is 
(45): 
0* = arg min ( sup |67 (t)v(X) — Dya) |) (45) 
GEN XEN 


with proper sets Q, for z(t) and Qo for O(t). Here, the minimum estimation error ||e(¥X)|| < €*, € > 0 is 
similar to that obatained in NN-based approach shown in (46): 


Dyn(x) = 0°1(X) + €(X) (46) 


Also, the parameter 6(t) is updated by applying the adaptive algorithms such that it reach 0* and reducing €(x). 

Some advantages of the fuzzy control approach in the literature include: reducing of the chattering and 
maintain the transparency [119], considering Markovian time-delay [84], [120], convergance of the state [121], 
state independent input/output stability [83], and asymptotic tracking [85]. The drawbacks of this approach 
include: considering constant time delay [85], [119], simulated delay [120], linear model and constant time 
delay [121], chattering torques [83], and decoupled master-slaves [84]. 


4. CYBER ATTACKS IN BTSS 

In this section, we will discuss the control problem of BTSs in the presence of DoS and deception 
attacks. First, we will explain the effects of DoS and deception attacks on the BTS. Then, we will propose the 
stability control problem of such a BTS in several circumstances. 


4.1. Background 

The communication among the items of BTSs, mainly the master’s and slave’s controllers, are oc- 
curred through a common network medium as shown in Figure 3. It is important to secure this network to 
prevent possible dangerous attacks during the communication of data. As explained above, the BTS could face 
instability or it is led to undesired operations by these attacks. Thence, it is essential to design controllers for 
BTSs while taking into accounts the security issues [122], [123]. 

Cyber attacks have two main types from a control engineering design viewpoint: 1) Denial of service 
(DoS) attack, which is a strategy that is often applied to occupy the communication resources to prevent the 
communication of signals among the system elements. 2) Deception attack, which is the modification of the 
data integrity for the communicated signals in the BTS [124]. 

Figure 3 shows a framework of a common teleoperation system including: an operator, master robot, 
master controller, communication network, slave controller, and slave robot. The position and velocity signals 
are sent between the master and slave controller through a communication channel. The network could be in 
any suitable wired or wireless structure such as a wide area network (WAN), the Internet, cellular, Ethernet, 
Wi-Fi, or a local area network (LAN). This network is affected by several cyber attacks in the forward path (the 
signal transmitted from master controller to slave controller) and/or the backword path (the signal transmitted 
from slave controller to master controller). 

In the presented framework, a teleoperation controller is designed such that the end-effector of the 
slave robot follows the corresponding position of the master robot. The interaction of the sub-task controller 
and the teleoperation controller is designed using theoretical formulations to achieve the stability for the closed- 
loop BTS [36]. Also, the human operator will know the remote environment through the feedback signals sent 
by the slave side. So, the human operator’s work is to control the slave manipulator and the slave robot has the 
capability to track the master robot and perform an extra sub-task autonomously. Due to the aforementioned 
importance of controlling systems in the presence of cyber attacks, many literature consider this urgent and 
major problems. Many literature discussed the DoS attacks alone [125]-[130], deception attacks alone [131], 
[136], or two attacks [123], [124], [137]-[139]. 
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Figure 3. Framework of a teleoperation system with cyber attacks 











4.2. Literature on cyber attacks in BTSs 

In section 4.2, we will present and discuss the literature that considers cyber attacks in the control 
of BTSs. One of the initial work that was to discuss the security of Telesurgical Robot Systems (TRSs) in the 
presence of unreliable network [140]. TRSs include critical operations in difficult situations or environments 
like disaster territories, underwater, and battlefields. In these situations, it is necessary to apply wireless com- 
munication. Thus, some challenges are introduced in TRSs including: delay in the signal, maintain a predefined 
threshold for the reliability, and providing several security measures that depend on the environment and the 
nature of the operation. 

An adaptive information coding method was designed to support both confidentiality and adaptive 
reliability simultaneously [140]. In this method, both light-weight privacy and adaptive reliability are integrated 
by using information coding in a single protocol named Secure and Statistically Reliable UDP (SSR-UDP). 
Another issue in the TRSs is to enhance the security of Interoperable Telesurgery Protocol (ITP) which is 
achieved by the collaboration between researchers in TRSs and security. The structure for the communication 
between the telesurgery robots and their controllers is determined by the ITP. A proof of concept and framework 
of Secure ITP was designed and presented [141]. In this project, open-source software tools were implemented 
for building a prototype for security enhancement. This prototype could be used to develop and demonstrate 
new security technologies in the field of TRSs. 

The possible class of attacks which may affect rescue robotic systems were explained [42]. These 
types of attacks may occur as a result of the Internet-enabled reach-back process. The set of required security 
and performance needed by rescue robots was discussed. Moreover, a method for mitigating this kind of attack 
was proposed. Many security threats may affect surgical teleoperation systems (STSs) since they use wireless 
communication, antagonistic operating environments, and work in a critical time operation. [43] analyzes some 
of the threats and discusses their impact. The threats affecting mobile STSs are classified as [43]: label 

(a) Attacks affecting the wireless communication: an unencrytpted wireless channel renders mobile surgical 
telerobotic systems could be affected by several attacks such as: 

— Eavesdropping. 

— Jamming. 

— Message modification/False data injection. 


(b) Attacks targeting surgeon-manipulator interaction: attacks that affect the wireless medium, including 
eavesdropping and message modification, are mainly mitigated by applying encryption algorithms. The 
STSs are rendered to a man-in-the-middle (MTIM) attack due to the lack of an authentication mechanism 
among them, which can be as follows: 


| 


Simple replay. 

— Delay attack. 

— Message dropping. 

— Combined delay and drop attack. 

— Message modification and spoofing attack. 


(c) Attacks on the surgeon-side software (such as attacks exploiting development (engineering) interfaces). 
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(d) Attacks on the manipulator-side software (such as attacks on the programmable logical controllers (PLC)). 


(e) Physical attacks. 

In 2015, Bonaci, Yan, Herron, Kohno, and Chizeck [144] analyzes cyber-security attacks against one 
of the advanced TRSs, Raven II R. Possible attacks were classified, and more attention was given to the denial- 
of-service (DoS) attacks, which cannot be avoided by implementing the existing cryptographic methods. The 
impact of these attacks on the TRSs was discussed using a set of experiments including human subjects. Also, 
possible steps to relieve the recognized DoS attacks were considered, and the suitability of these methods for 
TRSs was evaluated. A model-based analysis framework for estimating the consequences of control signals by 
computing the dynamic of the BTS in real-time is discussed [145]. The directed cyber attacks on TSRs which 
aim to affect the system by inserting malicious control signals during surgery were demonstrated. It is known 
that these kinds of cyber attacks could affect the physical system such as causing a sudden motion of the robot’s 
arm leading to affect the patient or damaging the robot or some of its parts during the surgery itself. Figure 4 
shows a typical structure for controlling surgical robots. In Figure 5, the kinematics chain in the tested robot 
RAVEN II control software is presented including all possible attacks. 
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Figure 4. Typical structure for controlling surgical robots: (a) The control structure of a TSR, (b) Control 
loops in the software and hardware in the RAVEN II, (c) operational state machine of the RAVEN II, 
(d) The surgical platform of RAVEN II. [145] 





Robotic Control fo — 
Software and Hardware Robotic Arms and Instrument 




















The basic architecture of an industrial robot is examined and a coherent deployment from a systems 
security point of view was analyzed [146]. Also, a model for the attacker is presented and compared with the 
minimum requirements’ set for industrial robots such as the precision to sense the surrounding environment, 
the correction in control logic execution, and the safety of human operators. 
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Using a practical experiment, it was shown how the proposed designed attacker can achieve the re- 
quirements by exploiting the software vulnerabilities. Also, the standard for safety and other challenges of 
security in industrial robotics were discussed [146]. 

A task-space control structure for BTSs with uncertainty in kinematic/dynamic, time-delay, and packet 
drops is discussed to achieve stability, enhance the tracking, and improve [147]. Moreover, a Passivity-Based 
Packet Modulation (PBPM) is designed to handle packet losses that occur in the communication of signals over 
the communication channel. 

Security challenges in BTSs reflect back to the operator reaction forces from the task being executed 
is discussed [148]. The cyber attacks are classified with regards to the objective component, knowledge of the 
system, and the purpose of the attack. Figure 6 shows all possible kind of cyebr attacks [148]. 
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Figure 6. Two-layers BTS with potential vulnerabilities 
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The attacks which aim to modify the content of signals on BTSs were discussed [149]. Initially, the 
vulnerability of BTSs to content modification attacks is considered, by which the attacker has the ability to 
change states i.e. the signals transmitted between the master and the slave sides. Then, a static malignant 
content modification attack (MCoMA) is defined such that to assure that the robot joint velocities are rendered 
unstable. After that, A safety mechanism is then defined to secure the system against static MCoMA. In the end, 
a dynamic subterfuge MCoMA that bypasses the safety mechanism is designed. Figure 7 shows the ability of 
the attacker to affect the signal between the master and the slave in several ways such as receiving, interpreting, 
manipulating, and transmitting the signals. 


Master Attacker Slave 


4 aw 
8L n & | 
Figure 7. The capability of the attacker to capture one of the nodes in the BTS 


False data injection attacks in BTSs are discussed, in which the attacker can insert false signal into 
the states being transmitted through the communication channel in the BTS [150]. a destabilizing false data 
injection attack (DFDIA) is created for demonstrating the vulnerability of the BTS and applied by experiments. 
A physics-based detection method including encoder and decoder is designed for detecting any FDI attack 
including the aforementioned DFDIA. For a BTS with a pair of nonlinear revolute robotic manipulators con- 
nected through a communication channel as presented in Figure 8. Now, let us ignore the external disturbances 
and friction, the dynamics of n-link master and slave robots are represented by (47): 


Mm (Gm) Gm ae Cmldm, dm.) Gm =Th + Um 





Ms(qs)äs T Cs (qs, ġs)ġs =Us — Te. (47) 
Human n 
operator Master Communication network Slave Environment 
.T TAT OO : a 
crores i mim | 
F \ ca A 
a o = Z 
(eae I @iay 
G, it, u, T, 


Figure 8. Example of BTS structure. 


The subscript 2 refer to both master and slave robots. Also, ġ;, qi, qi € R” are the angular acceleration, 
velocity, and position, respectively, M;(q;) € R”*” is the inertia matrix, C; (qi, qi) € R”*” is the centrifugal 
and Coriolis matrix, G;(q;) € R” is the gravitational torque, r; € R” is the robot control input, and Th, Te € 
IR” are torques exerted by the human operator and the environment, respectively. When there is no attack 
(qj = qi, fi = qi), the following PD-like controller can be adopted for BTS shown in (48): 


Um = — Kalim i ds) = Kp(am = qs) = Kamdm 
Us = Kalds Gin) Kp (4s dm) Kam4s (48) 





where Ka, Kp, Kam E RT. 

For the BTOS with a PD-like control method represented in Figure 9, the attacker can affect the 
system by FDI attacks, which can intelligently replace the signals (47 ,q7)T being exchanged by the robots 
with (qr : ge \T for i = m,s. For BTS, the DFDIA is discussed with respect to a specific form of storage 
function represented by (49): 


1. E hy . 1 
V= zis Meds + 5 din Mind T zs P qm)” Kp(qs — dm) 


t t 
— | Go,thds + Bn + l dT Teds + Be (49) 
0 0 
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Figure 9. The formal definition of DFDIA can be given as follows 


Theorem 1. Jn 2016, Dong, Gupta and Chopra [150] For a BTOS with dynamics (47) controlled by (48). A 
FDI attack that changes the states being transmitted between the robots of the BTSs as (50): 


J=q+q=q+kq (50) 
with q = (4? q7 42., 42)T, @= (4, £, 42, ,)', and “attack gain” constant K € R*"*4" is a DFDIA 


with respect to the storage function V in (49) if and only if: 1) P := A+ BK > 0 and 2) the set S\E is not 
positively invariant, where S := {q € R*” |q! Pq = 0} 


—(Kam + Ka)I[n On Kaln On 
A= On On On On 
E Kaln On —(Kam + Ka)In On 
On On On On 
On On Be  Kpln 

On On On 

PN eg Ah On On 

On On On On 


For each transmission sequence k;, the encoding and decoding factors are updated with the same 
dynamics f1, f2 as (51)-(55): 


‘Md =A + Tif ( A ki) 








i = + Ti f(A | ki) (51) 
and 

A tabi tT (al) 

‘ja = Ajo + Tifa ("Aja Ke) (52) 
Also, 
rag Ora Pe = gi HIAS ai. (53) 
gë ="a (ri — 1g), dii = ri ri (54) 
ki—1 

P a (55) 


T; 


The detection approach is summarized as shown in Algorithm 1. 
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Algorithm 1 Attack Detection Algorithm for i = m, s 
for k = 1, 2,3, ... do 

Update *A;, A2 as (51) {on the sending end} 
Encode ¢/, qf and send Ge s rit) as (53) 
Update '1,’A2 as (52) {on the receiving end} 
Decode Gr ; re) as (54) to recover hes Ti 
Check detection condition (55) 

if (55) is violated then 

Attack is detected and reject the received data 
else 

Utilize the received qi ee që * in the controller 
end if 


end for 








5. CONCLUSIONS 

The teleoperation system is often composed of a human operator, a local master manipulator, and a 
remote slave manipulator that are connected by a communication network. This paper presents a comprehensive 
survey on feedback control design for the BTSs in both nominal situations and in the presence of cyber-attacks. 
The main objective of the discussed methods is to achieve the stability of a delayed bilateral teleoperation 
system in the presence of several kinds of cyber attacks. In this paper, a comprehensive survey on control 
systems for BTSs under cyber-attacks is discussed. Finally, we discuss the current and future problems in this 
field. 

Several security issues of BTSs controllers have been discussed in the literature. However, many 
problems have not been addressed yet. some of these problems are: control framework encompasses the issue 
of time-varying delays and transparency in the tasks-space teleoperation system. Also, the problem of the dead 
zone in robotic arms and the use of the neural network for uncertainties. For the cyber attacks, the problems 
of considering several attacks in BTSs especially simultaneous cyber-attacks have not been discussed in the 
literature. Another promising research area is the implementation of deep learning and artificial intelligence in 
the detection and control of BTSs. 
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